Maximum Entropy Subspace Clustering Network

نویسندگان

چکیده

Deep subspace clustering networks have attracted much attention in clustering, which an auto-encoder non-linearly maps the input data into a latent space, and fully connected layer named self-expressiveness module is introduced to learn affinity matrix via typical regularization term (e.g., sparse or low-rank). However, adopted terms ignore connectivity within each subspace, limiting their performance. In addition, framework suffers from coupling issue between module, making network training non-trivial. To tackle these two issues, we propose novel deep method Maximum Entropy Subspace Clustering Network (MESC-Net). Specifically, MESC-Net maximizes entropy of promote its elements corresponding same are uniformly densely distributed. Furthermore, design explicitly decouple module. We also theoretically prove that learned satisfies block-diagonal property under independent subspaces. Extensive quantitative qualitative results on commonly used benchmark datasets validate significantly outperforms state-of-the-art methods.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

A Non-parametric Maximum Entropy Clustering

Clustering is a fundamental tool for exploratory data analysis. Information theoretic clustering is based on the optimization of information theoretic quantities such as entropy and mutual information. Recently, since these quantities can be estimated in non-parametric manner, non-parametric information theoretic clustering gains much attention. Assuming the dataset is sampled from a certain cl...

متن کامل

Entropy Weighting Genetic k-Means Algorithm for Subspace Clustering

This paper presents a genetic k-means algorithm for clustering high dimensional objects in subspaces. High dimensional data faces data sparsity problem. In this algorithm, we present the genetic k-means clustering process to calculate a weight for each dimension in each cluster and use the weight values to identify the subsets of important dimensions that categorize different clusters. This is ...

متن کامل

Maximum Entropy Analysis of Queueing Network Models

The principle of Maximum Entropy (ME) provides a consistent method of inference for estimating the form of an unknown discrete-state probability distribution, based on information expressed in terms of tree expected values. In this tutorial paper entropy maximisation is used to characterise product-form approximations and resolution algorithms for arbitrary continuoustime and discrete-time Queu...

متن کامل

Tsallis Maximum Entropy Lorenz Curves

In this paper, at first we derive a family of maximum Tsallis entropy distributions under optional side conditions on the mean income and the Gini index. Furthermore, corresponding with these distributions a family of Lorenz curves compatible with the optional side conditions is generated. Meanwhile, we show that our results reduce to Shannon entropy as $beta$ tends to one. Finally, by using ac...

متن کامل

Max-Entropy Feed-Forward Clustering Neural Network

The outputs of non-linear feed-forward neural network are positive, which could be treated as probability when they are normalized to one. If we take Entropy-Based Principle into consideration, the outputs for each sample could be represented as the distribution of this sample for different clusters. Entropy-Based Principle is the principle with which we could estimate the unknown distribution ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: IEEE Transactions on Circuits and Systems for Video Technology

سال: 2022

ISSN: ['1051-8215', '1558-2205']

DOI: https://doi.org/10.1109/tcsvt.2021.3089480